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Readiness  Analysis  for  Ships  Where  Both 
Modernization  and  Replacement  Are  Used  to  Increase 

Fleet  Readiness 


Introduction 

In  a previous  paper,  [2],  a model  dealing  with  an  optimal 
replacement  policy  for  a group  of  ships  was  developed  and 
analyzed.  This  model  was  based  on  a paper  by  Kalman  [1] , and 
involved  the  determination  of  the  optimal  replacement  interval 
under  conditions  where  the  expected  number  of  ships  suffering 
utility  (readiness)  degradations  greater  than  a given  value  was 
not  permitted  to  be  above  a specified  fraction  of  ships  in 
service.  Ship  readiness  was  associated  with  utility,  where 
utility  was  measured  on  an  ordinal-valued  scale. 

One  of  the  purposes  of  [2]  was  to  demonstrate  how  the 
optimal  replacement  interval  may  be  shortened  in  the  presence  of 
constraints  on  allowable  readiness,  and  a numerical  example  was 
given  to  illustrate  this  point.  However,  this  work  only  consi- 
dered replacement  and  did  not  consider  the  possibility  of 
modernization  as  a means  of  boosting  readiness  to  acceptable  levels. 
Modernization  which  will  be  specifically  considered  in  this  paper, 
represents  an  alternative  to  complete  replacement  and  may  be  more 
feasible  from  an  economic  standpoint  in  certain  situations. 

Modernization 

The  term  "modernization'''  will  be  used  in  the  sense  of 
rehabilitating  or  replacing  physical  equipment  or  facilities  of 
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a ship  which  have  either  (1)  suffered  physical  deterioration 
through  the  passage  of  time  or  usage  or  (2)  have  become  techno- 
logically obsolescent  in  terms  of  new  offensive  or  defensive 
capabilities  of  a potential  adversary.  As  equipment  deteriorates 
or  as  obsolescence  grows,  the  readiness  level  of  a ship  will 
decline.  In  [2],  it  was  assumed  that  the  decrease  in  ship 
readiness  was  a function  of  calendar  time  from  the  time  the 
ship  was  initially  put  into  service.  The  function  describing 
the  magnitude  of  these  decreases  at  a future  time  w as  assumed  to 
be  a random  variable  which  combined  both  the  physical  deteriora- 
tion and  obsolescence  effects.  In  a broader  sense  decreases  in 
readiness  will  also  occur  because  of  decreases  in  the  quantity 
and  level  of  competence  of  trailed  manpower,  and  modernization 
will  generally  involve  retraining  of  personnel  to  become  sophis- 
ticated in  the  use  of  new  facilities  and  equipment  as  well  as 
the  actual  equipment  replacement. 

In  the  present  paper,  it  will  be  assumed  that  the  decision 
maker  has  a choice  among  a discrete  set  of  alternatives  represent- 
ing different  levels  of  modernization.  One  of  these,  the 
greatest  degree  of  modernization,  represents  the  complete 
scrapping  and  replacement  of  the  existing  ship.  Although 
replacement  can  be  considered  as  a level  of  modernization,  there 
is  a difference.  With  actual  modernization  ships  must  be  taken 
out  of  service  in  order  to  be  rehabilitated  whereas  with  complete 
replacement,  assuming  that  the  new  ship  is  available,  it  can 
take  over  as  soon  as  the  incumbent  is  scrapped. 


To  allow  for  tne  modernization  time,  Kalman  introduced 
functions  y^  representing  the  time  required  to  accomplish 

a modernization  for  the  ship  in  the  sequence  of  replacements 
for  the  i ^ initial  incumbent  ship,  where  Lj  is  the  age  of  the 
replacement  at  which  modernization  commences  and  t^  is  the 
calendar  time  at  which  modernization  starts. 

Although  Kalman  distinguishes  between  modernization  and 
replacement  in  his  equation  for  the  expected  number  of  ships  in 
each  utility  class  at  time  t,  we  can  treat  both  simultaneously 
by  assuming  that  y^  (Lj,tj)  = 0 if  a ship  is  to  be  replaced  com- 
pletely and  that  y^  (L^.,tj)  > 0 if  a "lower"  level  of  moderniza- 
tion is  to  take  place.  Naturally,  the  increases  in  cost 
occurring  as  a result  of  complete  replacement  rather  than  the 
next  lowest  level  of  modernization  will  be  large.  Thus,  in  a 
sense,  we  are  paying  for  the  replacement  option  (the  one  having 
the  greatest  increase  in  readiness)  by  a much  larger  cost  outlay. 

This  analysis,  among  other  things,  will  investigate  the  conditions 
under  which  it  is  desirable  to  choose  this  option.* 

1 

If  replacement  is  chosen,  a sufficient  lead  time  to  construct  the 

new  ship  must  be  estimated.  Also,  it  is  not  known  during  con- 
struction exactly  what  the  readiness  level  of  the  replacement  will 
be  since  the  enemy  and  environmental  factors  may  make  the  replace- 
ment more  or  less  ready  than  originally  anticipated.  In  this 
first  analysis  we  assume  that  the  replacement  will  always  be 
available  when  required  and  that  the  utility  level  of  the 
replacement  is  known  with  certainty. 


It  will  be  assume  . ’:hat  a modernization  cost  function  can 
be  developed  which  rela-es  the  increase  in  readiness  or  utility 
level  to  expenditures.  In  reality  this  relationship  will  depend 
on  the  actual  level  of  utility  at  which  modernization  begins,  but 
initially  ;t  will  be  assumed  that  the  function  is  independent  of 
the  actu  < ‘ /cil : ty  1 . 

The  ••  ove  ’•‘u"' r could  -reasonably  be  approximated  from 
cost  data  on  equip:.  ■- r*-  , facilities,  labor  for  removal,  installa- 
tions, and  redesign,  etc.,  plus  estimates  on  how  the  ordinal 
value  of  utiiii...  will  increase  if  such  sums  were  expended. 
Presumably,  such  a 'unction  would  not  be  continuous  but  would  be 
of  a step- function  type  (as  shown  in  Fig.  1)  since  different 
levels  of  modernization  would  be  based  on  specific  concepts, 

-ach  requiring  a certain  capital  investment.  In  other  words  there 
would  be  a list  of  specific  investment  proposals  each  described 
by  an  expenditure  level  and  an  expected  amount  of  utility  level 
increase.  From  this  information  a function  of  the  type  described 
could  be  generated. 

A 


Increase  in  Utility 


1"  (2]  it  was  assumed  that  the  process  by  which  the  utility 

(readiness)  of  a ship  decreased  after  it  was  put  into  service  was 
a function  of  time.  Furthermore  it  was  assumed  that  the  process 
was  a random  one  where  the  probability  of  a degradation  of  j 
utility  levels  in  an  interval  T could  be  described  by  a Poisson 
distribution  with 

j ~ at 

prob{  degradation  = j}  = p.(T)  = <‘--L  ■- , e 

Another  model  for  the  degradation  process  which  involves 
discrete  time  and  allows  somewhat  greater  flexibility  in  being 
state  dependent  is  a Markov  process  model  with  transition 
probabilities  p^  defined  as  the  probability  that  if  a ship  is 
initially  in  state  i (readiness  level  i)  it  will  have  a decrease 
of  j levels  of  readiness  in  any  unit  time  interval. 

Here  time  t is  discrete  valued  (t = 0,1,2, ... ) and  the 

possible  readiness  states  may  be  defined  to  range  from  zero 

(highest  possible  state  of  readiness)  to  N (lowest  possible  state). 

Thus,  i can  range  in  the  interval  (0,N)  and  j = 0,l,...,i.  Uso 
i 

l p. . = 1.  We  assume  that  there  is  no  possibility  that  the 
j=0  13 

readiness  of  a ship  can  increase  merely  through  the  passage  of 
time.  As  mentioned  in  [2],  the  Navy  FORSTAT  system  does  use 
ordinal-valued  information  to  describe  the  readiness  status  for 
ships  at  the  present  time  so  that  an  ordinal  valued  utility 
function  has  some  relation  to  present  practice. 
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at  some  state  of  readiness.  In  the  absence  of  any  major 
modernization  or  complete  replacement  its  readiness  will  either 
stay  the  same  with  the  passage  of  time  or  decrease.  At  some 
point  there  is  a probability  greater  than  zero  that  its  readiness 
will  fall  below  some  minimum  acceptable  level.  At  this  point  a 
decision  has  to  be  made  which  depends  on  the  resources  (primarily 
funds)  available.  The  ship  can  be  permitted  to  stay  at  this 
undesirable  state  and  to  be  further  degraded.  Or,  the  ship  can 
be  taken  out  of  service,  systems  overhauled  and  modernized,  and 
be  put  back  into  service.  Or,  finally,  the  ship  can  be  scrapped 
and  either  replaced  by  another  or  not  replaced  at  all.  If  either 
modernization  or  scrappage  with  replacement  takes  place  a capital 
investment  is  required. 

When  there  are  many  ships  many  alternate  combinations  of 
the  above  decisions  are  possible.  Since  the  readiness  degradation 


is  a random  process,  different  ships  arrive  at  unacceptable  levels 
at  different  times  and  the  available  funds  at  each  time  plus  the 
changing  costs  of  modernization  and  replacement  may  play  impor- 
tanc  roles  in  any  actual  decision-making  process. 

In  order  to  facilitate  any  analysis,  several  types  of 
approximations  can  be  considered.  The  first  of  these  assumes 
that  all  ships  of  a certain  class  have  the  same  probability 
distribution  for  readiness  degradation,  are  in  the  same  state 
initially  and  are  degraded  independently.  Thu:;,  the  expected 
number  of  initial  ships  suffering  a specified  level  of  utility 
degradation  at  any  time  t may  be  found  by  multiplying  the 
probability  of  degradation  by  N,  the  total  number  of  ships. 


7 

Constraints 

One  of  the  principal  differences  between  the  nature  of 
the  constraints  of  [1]  and  [2]  is  that  in  [1]  it  is  required  that 
the  expected  number  of  ships  in  utility  class  "a"  (a = i, 2, . . . ,q) 
be  equal  ta  or  greater  than  some  specified  value.  Thus,  a 
separate  constraint  is  required  for  each  utility  class.  In 
Kalman's  notation,  Xa(t)  >_  Xa(t),  when  Xa(t)  is  the  required 
number  of  ships  in  utility  class  "a"  and  xa(t)  is  the  expected 
number.  At  any  ♦■ime  the  expected  number  of  ships  summed  over 
all  utility  classes  must  be  equal  to  the  total  number  of  ships 
initially  put  into  service,  since  the  model  does  not  allow  for 
scrapping  a ship  and  not  replacing  it.  Thus  any  ships  out  of 
service  for  modernization  purposes  can  be  considered  to  be  in 

A 

the  lowest  utility  class  q and  the  Xa(t)  cannot  be  chosen  arbi- 
trarily but  must  satisfy  the  additional  requirement  that 
% ~ 

l Xa(t)  = N.  At  any  rate  these  constraints  are  more  restrictive 
a=l 

than  those  of  [2],  In  fact  they  may  be  so  restrictive  that  no 
feasible  policies  are  possible.  In  [2]  the  approach  has  been  to 
impose  the  single  constraint  that  the  expected  number  of  ships 
suffering  utility  degradations  {decrease  in  readiness)  below 
some  given  level  at  any  time  must  never  be  less  than  a given 
value.  This  second  approach  has  the  advantage  of  greater  mathe- 
matical simplicity.  Furthermore,  it  would  seem  that  there  would 
be  much  difficulty  in  determining  consistent  inputs  among  Navy 
commanders  on  the  percentage  of  ships  of  a given  type  which 
should  be  at  different  levels  of  readiness,  whereas  the  input 
data  required  for  the  constraints  of  [2]  seems  intuitively 


e.  ■ ^er  to  obtain. 

The  formulation  of  [2]  led  to  a single  constraint  on 
the  service  life  of  the  incumbent  ships  and  a single  constraint 
on  the  service  life  of  the  replacement  ships.  These  were  of 
the  form 

L < L and  L < L 
o—o  — 


where  Lq  represents  the  life  of  the  incumbent  ship  after  which 
the  expected  degradation  in  utility  will  be  greater  than 
desired,  and  L represents  a similar  life  for  the  replacement 
ships.  The  Lq  and  L are  determined  as  the  minimum  values  of  a 
set  of  numbers  and  which  may  have  to  be  found  by 

numerical  approximation. 

Let  us  now  examine  the  process  involved  for  a single 
ship  assuming  that  t is  discrete  and  that  the  analysis  is 
confined  to  a finite  time  horizon  T.  Many  alternate  sequences 
of  events  are  possible. 

Figures  2-4  illustrate  some  possibilities: 
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As  observed  above,  foi  discrete  t there  are  a large  number 


of  possibilities  which  can  occur  in  (0,T).  In  order  to  reduce 


the  problem  to  a form  where  analysis  is  possible  we  shall  refer 


to  nfch  order  sequences  when  an  nfc^  order  sequence  is  defined  to 


be  one  involving  only  the  incumbent  and  exactly  n of  its 


successors,  which  may  be  either  replacements  and/or  moderniza- 


tions. Thus,  a first  order  sequence  involves  only  the  incumbent 


ship  and  its  immediate  successor  (whether  a modernization  or 


replacement).  A second  order  sequence  would  only  involve  the 


incumbent,  its  possible  successor,  and  any  possible  successor  to 


it.  Figure  2 illustrates  a second  order  sequence  in  (Q,T). 


Figure  3 is  a zeroch  order  sequence  and  Figure  4 is  a third  order 


sequence  in  (0,T).  The  basis  of  our  analysis  is  to  determine 


an  optimal  policy  by  the  minimization  of  the  present  value  of 


cost  subject  to  a constraint  on  allowable  readiness.  Other 


things  being  equal,  events  occurring  far  into  the  future  affect 


the  present  value  less  than  events  in  the  immediate  future 


because  of  the  discounting  process.  Thus,  it  seems  reasonable 


in  an  initial  analysis  to  consider  only  zeroth  and  first  order 


replacement  and/or  modernization  sequences.  These  considerations 


follow. 


Analysis  for  First  Order  Sequences 


The  possible  sequence  of  events  if  only  the  incumbent  ship 


and  its  possible  immediate  successor  are  considered  are: 


(1)  Retain  incumbent  for  t = T without  replacement  or 
modernization  (zeroth  order  sequence) . 


J 
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(2)  Retain  incumbent  for  t = t^  after  making  decision  to 

replace  it  with  a new  ship  at  t = t , t < t, . Retain 

o o—l 

replacement  until  t=T. 

(3)  Retain  incumbent  until  t = t2  and  take  it  out  of  service 
at  t ==  t2  after  which  modernization  takes  place  and  the 
ship  resumes  service  at  t^t^,  t^f^tj.  Retain  modernized 
incumbent  until  t = T. 

In  (1)  the  readiness  (utility  level)  will  tend  downward 
with  time.  In  (2)  there  will  be  a downward  trend  in  readiness 
followed  by  a rise  at  t = t^,  when  the  replacement  takes  over, 
followed  by  a declining  trend,  and  in  (3)  there  will  be  a down- 
ward trend  until  t = t2/  when  readiness  will  drop  to  the  lowest 
possible  level  while  being  modernized,  after  which  it  will  rise 
to  a higher  level  at  t = t^  before  starting  to  decline  again. 

With  respect  to  investment  costs  there  are  none  in  (1) 
whereas  those  of  (2)  and  (3)  depend  on  the  level  of  modernization 
as  shown  in  Fig.  1. 

In  order  to  focus  the  analysis  on  the  optimal  choice  of 
policy  subject  to  the  constraint  on  readiness  and  to  make  the 
problem  mathematically  tractible  we  shall  assume  that  the 
operating  cost  function  of  any  ship  is  constant  over  its  future 
lifetime  as  assumed  in  [1].  However,  it  will  be  assumed 
that  the  operating  cost  functions  of  any  replacement  to  the 
incumbent  (or  of  the  modernized  incumbent)  are  different  from 
that  of  the  incumbent.  In  particular,  let: 

0 = operating  cost  rate  of  the  incumbent 


0 ^ = operating  cost  rate  of  any  modernized  incumbent 
after  modernization 

02  = operating  cost  rate  of  any  replacement  ship  after 
replacement 


= readiness  level  increase  obtained  because  of 
modernization  or  replacement 

= cost  of  a replacement  ship  which  will  obtain 
increase  in  readiness  of  C 

= cost  of  modernization  necessary  to  obtain  increase 
in  readiness  of  C 

= present  value  of  total  costs  of  any  alternative 


WT(C) 


WT(C) 


w 


l 


t 
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Now  if  we  consider  a fixed  horizon  T we  can  determine  the 
present  value  of  total  costs  of  each  of  the  three  possibilities 
using  a nominal  interest  rate  r which  is  assumed  to  be  com- 
pounded continuously. 

First  Alternative:  Do  not  modernize  or  replace  and 

continue  to  use  incumbent  over  the 
entire  time  interval  (0,T) 

T 

w = | ♦oe-ridt  = ^ (1  - e'rT) 

o 


r 

: 

: 

f 
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Note  that  there  is  no  investment  cost  of  any  kind  because 
the  initial  investment  in  the  incumbent  is  a sunk  cost  and  is 
not  a valid  part  of  any  analysis.  Also,  the  salvage  value  is 
assumed  to  be  insignificant  in  its  contribution  to  the  present 
value  of  total  cost.  Zero  salvage  values  will  also  be  assumed 
in  the  other  two  alternatives,  approximations  which  should  not 
produce  serious  errors. 

Second  Alternative:  Make  a decision  to  replace  incumbent 

at  t and  replace  it  at  t,  > t . 
o l—o 

Use  the  replacement  in  the  interval 

(tx,T) 


fit 


-!1 


^1  -rr  - _r  (t  ft-  )/2  T{ 

j <pQe  r dr  + WT(C)e  + j i>2e  rrdr 
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Note  that  the  time  t at  which  a decision  to  replace  is 
made  does  affect  the  present  value  of  total  cost.  This  is 
because  the  replacement  cost  WT(C)  will  be  assumed  to  occur  in 
the  interval  (tQ,t^)  where  a replacement  has  to  be  built.  For 
convenience,  we  assume  that  this  entire  cost  occurs  at  the 
mid-point  of  the  interval.  However,  t will  not  affect  the 
readiness  level  of  the  incumbent  or  replacement  since  the 
incumbent  continues  in  use  until  it  is  replaced. 

If  a ship  is  taken  out  of  service  for  modernization  at  t2 
this  will  affect  the  readiness.  The  ship  will  be  out  of  service 
in  the  interval  (t2,t2)  (assuming  that  the  ship  is  taken  out  of 
service  at  the  same  time  that  a decision  to  do  so  is  made)  and 
its  readiness  will  drop  to  the  lowest  possible  level  assumed. 

The  time  t3  represents  the  time  when  the  modernized  ship  re-enters 
service,  and  this  represents  the  third  alternative. 


Third  Alternative:  Make  a decision  to  modernize  incumbent 

at  t2,  take  it  out  of  service  at  t2, 

modernize  the  ship,  put  it  back  into 
service  at  t^  and  use  the  modernized 

version  in  the  interval  (t3,T) 


i 
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)2  -n  -r(t2+t3)/2  T 

w — j <^oe  ridx  + W(C)e  J + J rTdx 


w = -~  (1-  e 


-5  -r(t,+t,)/2  4>,  -rt_  _ _ 

+ W (C) e 1 J + — (e  6 - e ri) 


We  assume  that  the  modernization  cost  is  incurred  uni- 


formly over  the  modernization  interval  (t2»t3)  and  approximate 


the  present  value  of  this  cost  by  assuming  it  all  was  incurred 


at  the  mid-point  of  this  interval. 


We  must  now  bring  in  the  constraints  on  readiness. 


Instead  of  requiring  that  the  fraction  of  ships  having  utility 


degradations  > r levels  be  less  than  a specified  value  for  all 


t in  0 < t < T,  suppose  this  requirement  is  imposed  on  only  a 


finite  set  of  times  (t,  2t,  3t,  nt)  in  this  interval. 


Furthermore  suppose  that  modernization  or  replacements  can 


only  be  initiated  at  such  times  and  that  the  modernization  time 


when  a modernized  ship  will  be  out  of  service  is  equal  to  kt, 


k < n.  That  is,  kt  = t3  - t2. 


Consider  the  constraints  at  some  rt,  0 < rt  < T.  Suppose 


N = the  total  number  of  ships  initially  jn  service 
at  t = 0 . 


N^(rt)  = the  number  of  incumbent  ships  in  service  at  rt. 


N2  ' (rt)  = the  number  of  incumbent  ships  that  we  decide  to 
i begin  modernizing  at  rt  and  take  out  of  action  at 

this  time 
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(2) 

N2  (rt)  = the  number  of  already  modernized  ships  in  existence 
at  rt  and  in  action 


-*r 


If  "3 


\ 


I 
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N-(rt)  = the  number  of  ships  at  rt  which  are  replacements 
of  incumbents. 


We  have  the  following  constraints  which  must  hold  for  all 


rt: 


N1  (r  t) 


N<2>  (rt) 


N 


= N - N,(rt)  - l N^1)  (mt) 


m=0 


r-k  \ 
l N2  (mt)  , 
m=0 


r > k 


= Nx  + N^1}  + N^2)  + N3  for  all  rt,  rt  < 


Plan  for  Simulation 

It  is  obvious  that  for  first  order  sequences  when  (1) 
following  a set  of  N initial  incumbent  ships  during  the  interval 
(0,T),  (2)  allowing  for  modernizations  and/or  replacements  at  a 
discrete  set  of  times  t,2t,...nt  in  this  interval  and  (3)  satisfy- 
ing constraints  on  readiness  at  each  one  of  these  times,  the 
mathematical  difficulty,  even  under  the  simplest  assumptions 
on  operating  costs,  becomes  enormous.  Therefore,  we  are 
proposing  that  a microsimulation  of  this  problem  be  undertaken 
in  order  to  obtain  insights  as  to  how  some  of  the  parameters 
of  the  model  proposed  will  affect  the  optional  modernization 
and  replacement  policy. 

The  model  would  operate  as  follows:  Each  incumbent  ship 
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will  be  assumed  to  start  at  some  initial  level  of  readiness. 

The  readiness  degradation  process  for  each  ship  proceeds  accord- 
ing to  either  a Markov  process  or  the  process  assumed  in  [2]. 
Sequentially,  at  each  time  point  rt  (r  = 0,1, . . . ,n)  beginning 
at  t = 0,  the  percentage  of  ships  in  each  readiness  category  is 
determined  and  compared  with  required  values  (according  to 
the  way  the  single  constraint  is  sta^-d  in  [2]).  If  the 
constraint  is  satisfied,  the  degradation  process  can  either 
continue  to  the  next  time  point  or  one  can  start  modernization 
or  replacement  decisions  in  anticipation  of  future  situations 
where  the  constraint  will  not  be  satisfied.  If  the  constraint 
is  not  satisfied,  a definite  choice  must  be  made  as  to  which 
incumbent  ships  will  be  upgraded,  and  a decision  rule  for 
choosing  such  ships  has  to  be  formulated.  One  possible  choice 
is  to  select  those  ships  having  the  greatest  levels  of 
degradation.  Another  is  to  select  those  with  the  lowest  utility 
levels.  After  the  choice  of  ships  is  made,  decisions  have  to 
be  made  on  which  to  modernize  and  which  to  replace.  It  is 
anticipated  that  the  simulation  will  consider  an  experimental 
design  where  alternate  combinations  will  be  tried.  The  basic 
decision  criterion  is  the  present  value  of  total  cost  subject  to 
the  satisfaction  of  the  readiness  constraint  at  each  discrete 
time  point. 

In  theory,  since  we  ztall  start  with  a finite  number  of 
ships,  make  decisions  at  only  a finite  set  of  time  periods, 
and  have  a finite  set  of  alternatives  at  each  time  point  there 
are  only  a finite  set  of  alternate  policies  that  are  available. 


